Tail-scope: Using friends to estimate heavy tails of degree distributions in large-scale complex networks
نویسندگان
چکیده
Many complex networks in natural and social phenomena have often been characterized by heavy-tailed degree distributions. However, due to rapidly growing size of network data and concerns on privacy issues about using these data, it becomes more difficult to analyze complete data sets. Thus, it is crucial to devise effective and efficient estimation methods for heavy tails of degree distributions in large-scale networks only using local information of a small fraction of sampled nodes. Here we propose a tail-scope method based on local observational bias of the friendship paradox. We show that the tail-scope method outperforms the uniform node sampling for estimating heavy tails of degree distributions, while the opposite tendency is observed in the range of small degrees. In order to take advantages of both sampling methods, we devise the hybrid method that successfully recovers the whole range of degree distributions. Our tail-scope method shows how structural heterogeneities of large-scale complex networks can be used to effectively reveal the network structure only with limited local information.
منابع مشابه
Exchanges in complex networks: income and wealth distributions
— We investigate the wealth evolution in a system of agents that exchange wealth through a disordered network in presence of an additive stochastic Gaussian noise. We show that the resulting wealth distribution is shaped by the degree distribution of the underlying network and in particular we verify that scale free networks generate distributions with power-law tails in the high-income region....
متن کاملStatistical Wavelet-based Image Denoising using Scale Mixture of Normal Distributions with Adaptive Parameter Estimation
Removing noise from images is a challenging problem in digital image processing. This paper presents an image denoising method based on a maximum a posteriori (MAP) density function estimator, which is implemented in the wavelet domain because of its energy compaction property. The performance of the MAP estimator depends on the proposed model for noise-free wavelet coefficients. Thus in the wa...
متن کاملAdaptive Bayesian Shrinkage Estimation Using Log-Scale Shrinkage Priors
Global-local shrinkage hierarchies are an important, recent innovation in Bayesian estimation of regression models. In this paper we propose to use log-scale distributions as a basis for generating familes of flexible prior distributions for the local shrinkage hyperparameters within such hierarchies. An important property of the log-scale priors is that by varying the scale parameter one may v...
متن کاملTail Index Estimation for Parametric Families Using Log Moments
For heavy-tailed econometric data it is of interest to estimate the tail index, a parameter that measures the thickness of the tails of the marginal distribution. Common models for such distributions include Pareto and t distributions, and in other applications (such as hydrology) stable distributions are popular as well. This paper constructs square root n consistent estimators of the tail ind...
متن کاملUnderstanding Heavy Tails in a Bounded World Or, Is a Truncated Heavy Tail Heavy or Not?
We address the important question of the extent to which random variables and vectors with truncated power tails retain the characteristic features of random variables and vectors with power tails. We define two truncation regimes, soft truncation regime and hard truncation regime, and show that, in the soft truncation regime, truncated power tails behave, in important respects, as if no trunca...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 5 شماره
صفحات -
تاریخ انتشار 2015